Spatial Congruity in Audiovisual Synchrony Judgments
نویسنده
چکیده
Rainer Guski Dept. of Psychology, Ruhr-University Bochum, Germany [email protected] Abstract The systematic analysis of the perception of audiovisual synchrony has shown that auditory delays are tolerated to a certain extent in synchrony judgments, but the variation of spatial separation between light and sound has brought conflicting results: While Lewald & Guski (2003) did not find a significant influence of spatial separation in synchrony judgments, Spence et al (2003) did find one in temperal order judgments. This may be due to methodological differences between synchrony and temporal order judgments, but it may also be due to spatial congruity, which was randomized by Lewald & Guski, and was confounded with spatial separation by Spence et al. (2003). The present contribution asks if audiovisual synchrony judgments are influenced (1) by the sound reproduction system, and (2) by the spatial congruity of light and sound. The results of an experiment are presented that asks participants for quick Yes/No-Responses with repect to audiovisual synchrony and varies systematically three factors: (a) the audiovisual synchrony (-250 to +250 ms), (b) the sound reproduction system (earphones vs. loudspeakers), and c) the spatial congruity (left and right) of light and sound stimuli. The results do not show a systematic influence of spatial compatibility of the audiovisual stimuli on raw synchrony judgments. . Introduction Audiovisual judgments of synchrony or temporal order depend on a number of influences,e.g. the type of stimuli used (with speech producing greater just noticeable differences (JNDs) than abstract stimuli), the type of task (with synchrony judgments (SJ) producing greater JNDs than temporal order judgments (TOJ)). The spatial separation between light and sound is also claimed to have an influence (Bertelson & Aschersleben 2003; Spence et al. 2003; Spence & Read 2003; Zampini et al. 2003a,b), but Lewald & Guski (2003) did not find a significant influence of spatial separation on synchrony judgments. The difference between results fromdifferent laboratories may be due to methodological differences between synchrony and temporal order judgments, but it may also be due to spatial congruity, which was randomized by Lewald & Guski (2003), and was confounded with spatial separation by Spence et al. (2003). The present contribution asks whether audiovisual synchrony judgments and decision times for these judgments are influenced by the spatial congruity of light and sound.
منابع مشابه
A Psychophysical Investigation of Differences between Synchrony and Temporal Order Judgments
BACKGROUND Synchrony judgments involve deciding whether cues to an event are in synch or out of synch, while temporal order judgments involve deciding which of the cues came first. When the cues come from different sensory modalities these judgments can be used to investigate multisensory integration in the temporal domain. However, evidence indicates that that these two tasks should not be use...
متن کاملVisual and Auditory Components in the Perception of Asynchronous Audiovisual Speech
Research on asynchronous audiovisual speech perception manipulates experimental conditions to observe their effects on synchrony judgments. Probabilistic models establish a link between the sensory and decisional processes underlying such judgments and the observed data, via interpretable parameters that allow testing hypotheses and making inferences about how experimental manipulations affect ...
متن کاملSpatial Congruity Effects Reveal Metaphorical Thinking, not Polarity Correspondence
Spatial congruity effects have often been interpreted as evidence for metaphorical thinking, but an alternative account based on polarity correspondence (a.k.a. markedness) has challenged this view. Here we compared metaphor- and polarity-correspondence-based explanations for spatial congruity effects, using musical pitch as a testbed. In one experiment, English speakers classified high- and lo...
متن کاملHysteresis in Audiovisual Synchrony Perception
The effect of stimulation history on the perception of a current event can yield two opposite effects, namely: adaptation or hysteresis. The perception of the current event thus goes in the opposite or in the same direction as prior stimulation, respectively. In audiovisual (AV) synchrony perception, adaptation effects have primarily been reported. Here, we tested if perceptual hysteresis could...
متن کاملTemporal Adaptation to Audiovisual Asynchrony Generalizes Across Different Sound Frequencies
The human brain exhibits a highly adaptive ability to reduce natural asynchronies between visual and auditory signals. Even though this mechanism robustly modulates the subsequent perception of sounds and visual stimuli, it is still unclear how such a temporal realignment is attained. In the present study, we investigated whether or not temporal adaptation generalizes across different auditory ...
متن کامل